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I understand th^t i number' of you are interested in developing 

compu(ter understanding systems, and mor e specif x ieigrlllyii ques'tion"^" • 
ft 



"aSswer^ systems ♦ Le t ^ s ass~um<^ , f ol? an liour ^ haye^ the 

.same goiau>sin mind« We w6uld like to construct system that under-** 
"Stands some «>Mment of t!he Engdlsh .language in written fj^. The. ^ 
system ^Will und^retand a limited vocabulary, and a IdmitecJ ^number of 
syntactic consti^uctions* |"It will accept only sentences that are 
requests in questionVorm,/ and senteiic^^ 

declarative form* -It won it, for example', be all^ to e^Qcept J 
sentences in imperative rorm, conditional senten dfes, etc* . 



^ The system will have some fac;:ts about certain subjects stored 

in its'memory in some canonical form. It will ^e able to represent 

the meaning of 4 &ent;pjLce in this . canonical .fonh,, and will ha^c a ^ 

way to translate from 'English *4nto this canonical form. The^task / 

of the system is to use its knowledge , in conjunction with a 

problem-solving sj/stem, to understand certain questions posed to 

•it,, interpret^ those questions as^ specific commands, search its 
. • " . • . I •'' * , 

memory for the relevant facts, and produce the appropriate answers. - 

yhis is thfes^oal* The question now becomes, what- would the 

system have to know in order to perform the^pperations involved in 



urderstanding the. question, searching for the f acjtj5.,_and^gi5Ling- the- 

^iswer* Another way of stating this question is to ask what know- 

ledge^ the speakers of Englisl? possess- that allows them to^ perform ^ 

the same' operations. ' ^ ' ' . • 

You notice ,*xhat many elxamples in this'papei? are stated 

. '\ * \ • ' • . • - 

in tei^ms of a fact, a question, and an answer. Let's assume that 



the facts represent knowledge that our system has. The questions 
rfe^resent requests for information that we have made of the 



system 3j and the answers represent responses we would like the 
system to make. Giv^n these facts"'" and these qufeVtionI', we can:. 
--fACUSu-on-what— the-system-wou-ld- have- to ^now~in orderrtc^ come- up 
with the responses listed* . Now, if were operatin)r^with 4n 
actual system only the questions and the answers woulci be " 
represented in English.^ The facts would be. stored in sWe 
notation which wasMnd>5j^ndent Of , actual English words. \B\xt 
^ uri^e-^Jth ere is^Q-^jwte4:l^n- a -v^ i --la ble ^r - that W e-^ all - 



feimiliai? with, so. I have been forced to represent, the -fajj4s i^.- 
English also. 'I have' tried to represent the facts— in^ such a. way 
that they are semantically. transparentT I mxy hive failed in 
some cases, and I apologizeHn~aclvance for that, / 

My 3 ob today, then\ is to try to characterize some of the 
knowledge of the semantic structure of their language* that 
■pej3ple have. I think I can do that", but I can't do it in 
isolation from syntactic structure. I don't think -that one can. 
draw sharp distinctions between syntax arid semantics* 

. Most people who study languages assume, correctly I think, 

that the meaning of- a^-sentence is composed, of - the meanings of its 

/ ' 

parts. In order to understand the semantic structtire of a 

-• - - --■ ■ , 7 

sentence we Tnust know what its ^-^tc^ ^t^p j = in d hoVy these nartg ar::^ 



related to each o'ther. In ciescriptiye terms we can say that the^e 
parts ^are related to each other. Tn descr^tive terms v;e can say 
tha^ : .A. a description of the syntactic structure of a 



■ .... :l 



language will t^ll us what the elements in the 
language are, and how they can' be combined. 
B.. a description of the semantic structure will tell 
us what the meanings of the elements are, and 
what the meanings of the combi^ia|tions are* . To 



\- . ; " attempt to do semantics without syntax would 

* • ' ' . >' ~ ' - <^ 

_ j ^ be to descri be the meani ngs of - the elements 

y : " ■ ' " ^ . . ' . ' " 

' ^ , aad their- combinaticyis without knowing what - 

; • ti\e elements and their combinations aren * 

Because , of time limitations, I would lilce to divide the 
meaningful elements of Eh^lish .into? two groups - the set of wor^^ 
and the set of sentences. This ^ of icourse, .is a gross^over- 



.V 



simplification which obscures many semantic facts that heed fo 
be charjacterized* But by limiting myself to only two groupsj-^ 
in this way', I can J^etter forcus in the general propertxes* that 
they exhibit and the general relations that they enter irito;^ 
^^ormally we use w6rds>feo ^.escri,Se..and to refer to what's 



^ing . on in the woi^W # The' word Russian , in the phrase 
the Russian is, in general , used to pick ouX:.4ojae_pai^^ 
individual ii^ith certain^ pharacteristic^* And the word hit ^» , 
as sentence - the .Russian hit the ball , is. used to pick out 

some^ particular activity of a certain type. But not all words 
have these functions of . describing and referring in all cases. 
.'These is a small group of words, which can serve as syntactic- 
I indicators with little if any descriptive contents or referential 
'use." \ \ ' , • ' " 



I 



1. It annoyed, the Russian that he couldn^t hit the ball 
In (1) both it and that have no descriptive content-^— and-^fehey^ 



T^don^t refer to anything*' It is functioning as a sort of place 

for 'the subject position and that serves to^mark the following 

/• - . * ' ; • ■ , * r ' • . 

clause as subordinated. * 1 ' « - 

' ,i ' ' 
- ; If you take a descriptive word like boy , you would want to 

' say that it has meaning' which is in6[ependent of the object you 
:cLJ?eJfen to* You might want 



||^pj(-" use\ it tCLJ?efen to* You might v/ant to. characterize it, in terms of 



• \ ■ - . / , • . . 

I • semapftic primes like 'human', 'male* , 'young'-. But there is a class 

'^'^ -words , . called deictic words or indexicals, which have little feontent 



but side of a particular context. That is, we use them to refer but 



not .^o describe. / : ' 

/ f . • . * 2.. a) There's- a Russian^ who Vs in my class / 



b) Th^re's^a Russian who's in my lab who doesn't like 
Egyptians t ' ^ ^ 



In-(2b) the ;^ord Inhere is most commonly »used as -a syntactxc^andTcator7 
It doesn't have meeining and -doesn't refer-.''' In (2a) the wore, there, 
and the word my, are both used to refer to something. But without ' 
knowledge of the situation^- in which this sentqnce^.occurs , wfe doa!t-^ 
know what they refer t6,.^and^we can't ^ay anything, about whether. the 
, sentence is true or . not . .The implications for a qufestion ahsweri^jg^ 



system aM obvious. The system will l(ave to make, decisions, about when 
word tloesn't refer, -and^when it does. And if t^e word- reefers , the 
system will have to decide what, in the preserj^t -context , the word - 
refers to. v / ' ^ . ^.rr-----i _„-,-^-^--r 

•3. fact; Three people are in the iabt^ a Russian, an Egyptian^, :_ 



. . ' ^ arid Henry .| / / . . 

• Q.: Is there a Russian in the: room ^with' me? > • 

. i , _ ' ft i . 

"T: Yes ^ ^ — ; 
In order to answer this questioa, the ;gystem has to know that the \ 
word there does not refer, and that the word me does refer ^ and* also 



\ th at^the r^^ff^rfint of the . woruiJme J^s^ot^the Russian.^^ The refereht^ -~ 
' " mu^tf be" either 1£he Egyptian >r lien^y. ^ / >. . / 

Another more complicated cas^; is chd, use'of one in the following 
example: 



»». fact: One country left tlje UN and one country joined 
^' . ^ -NATO ^- ^ • ^. . / 

Q: bid-^ne country, leave the UN and join NATO?^ 



-__^.^__A:' No - - ^ . 

Ihe^phnas3 ^ one country ' tells us that we are referring to a* country, 



ri-s-ment5oned-t\d.-cev^ couhtri^ 
are being referred to* The Q asks if one country did two things. - The 



fact tellsrthat two countries did one thing each* ' T^^^capituiafe 
what I've said ^o far - we can describe words in terms of their 
descriptive propertic^s, and their referential pr oper tie sj. Words can 
be said to refer, and they can be 'said not to refer. Of\ the words 
-t^iat— are-used"^ to"T^efi?r7 some can be said to have descriptive content 



A, 



independent of context, others have onlv conlrext depend entv' content . 

.But even for words^ wh±ch"^lW£Qr^"lrave descriptive content, it. \ 
jLs.^not /enough to know their meanings in isolation. . They enter into 
relations witfi other words which * add to their meaning ♦ We sometimes 



^caXrth^^jid ded meaning categorical . meanin g^,__a5-_opposed to cognitive- 



X 

meaning. 



5. a) The Rus.sian told the Egjr^tian ^ 

. • b) The Russian fell into the Suez Canal 

\ . ; ^ 

, /"c^) The Russian 'looked nervous 



case the/ word is~the subject of the s^tence, and yet we perpe^e 
that the r illation of the wo^d to th^^ verb is different in each case.- , 
In (a), we know the Russian is the/actor; jLn.(b), he is the 
experiencer or patient; in (c), he/is neither . A question 
answering system has to know ti^XB kind of information in order, to 



in each case, but not ?whdfch country. We need a- more complete context, 
to decide that. But in a<idition, the fact, that the phrase^©, country ^ 



In each case we know^he meaning of the ^ord« Russian , and in ea9h^ 



Kiecide what, of all the inforinatioi^vit^.h^^ stored about the . 




> r \ 



Russian » ♦'ill be. appropriate as ar^^dt^wer to diff^renj:' ki nds j of 



questions. Let's assume tha$ ;^e have (a), (b), (c>- stored \€Ls 
facts 'in the system, In^aTnswfer to question 6, only (ali is an 



appropriate "auriswer . 



" 6-..; iQ: .,^W&t>,did the Russ-i-an-d<^- 




-/- 
A: 



The Russian told the Egyptian 
In answer to 7, only (1>) is appropriate. - 



I 



' 7 . . Q : What. happened to . the .Russian? 



\ 



A: He fell into the Su^z^^O^ai 
']|^here is no generalized question fbrm which v;ill get at the 
information in {&)\^^ 'order to get at that <^ind - of infotinatloA^ 
Irhe ques'tioa ^would have to be'^much more specific* • 

Words also enter into relations with the syntactic srtructui|»es . 
in which they occur. , ^his interrelation/ serves to delimit the 
meaningful functional role which_tj>e^ word has in that_ stnuctuce, 
An example of the relations . between words and the structure they^ 



-^cear—in— is--' th e follo w ing 7 



/ 



8. fact: -The Russian promised fthe Egyptian (to go). 

f' ' ■ ' ' 

Q: Did the Russian promise fto go? ■ . 

. • ■ . f ,1 

Yes ; . I • • 



A: 



9. The Russian expected (the Egyptian to go 




Dfa the Russian expect to go? 



-\ 



.ERIC 
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4n this^ cascj it is the difference in the under l^iTignstructural relaA 
tion thai the two verbs onter into whichydetermine that the ... 
Russian, wouid do the ..going lin 8, and tha/the Egypt j.an woul^ do' 
the going in 9. The parentheses in tli6 facts, in' 8 and 9. are there 
t6 Show that the information . is not Ztored in k|i ambiguous syntactic /,• ;■; 





..fbiwa_ in. tlie system^ . liut the ^questpjiS-.Asked-:arie-jexiir& 



same syntiictic .form, and it\is the! relation of the verb to the 



• cont:^uction whicii V7lll disambiguate, these cases'. 



I 



^ A : 




\ 
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•I '4 l^iJsej~to leave the difscussion of words liow, and go on to a 
discussion of sebtences. Many properties that we can predicate 

' — ^ • 



of words:,^e can also predicate ©f-sentences^. 

L- :J. . — --<> 



Let us rirst focus on properties of senteiices, and then go into a 
,disfeus:^ion ot the relations that, sentences can enter into* There 
are a-^mber of properties that sentences can have» Thev can-be_:— 



/Analytic, 'they c^in be contradictory v- tjidy- can be ambiguous. The 



f iipst two properties r althoughthey^jy,^^ 

•logicians will not be, ;: thi^k,\pf interest to those inj^lefeted . 
in our Q answering systiim,.so I wiXl^igi^ore theV* ' 
of ambiguity oi' \sentences is one thatxis essential fo2^ us to face\ 
-A-- sentence^ can'* be luSBigu^ in different, ways j it can be. structurally 



.But jthe pro^e?»ty 



' ambiguous Tl^ecajuse one suxjf ace structure can^ represent two or more, ♦ 
• under lying structures J it can be lexically ambiguous because one 



or mwe words have different meanings, which have ndt b^en. 



•elimijrxatedi.by the meanings of the other worlds in^^he sentence;' an^i 

' , , • ' . / ■ ' ' ' • • • 

sentence can be referentially ambiguous - whit I have in mind here 
is iJi\fact that we can Use language to refer to objects or events 
in the. world, but we can also use it to refer to the descriptive } 
-content^f the words in^the sienterice. itself . > • . ■• 



- jStriictural '~ambiguit;y occurs when different underlying structures 
•are' altered Vn such a way as to make thenj look the same when, they are 



UGer4^in-4Lexioal^-tem-Gan~^ 



^e '.1 



underlying structures,'' and both ^underlying structures have the s 

Y ' \ } ^ ' ' . • 

surf ace -structured then that \resiilting surface ^structure is / 

iguoiis* Look fii^st at, t^e\ question of 10* It is ambiguous*/ But ^ 

io^s , ^1^^ meani: 




both interprfetataor 



eanxngs of the words are the same. 



difference in syntactic relations which gives us the 



10 



differ ence in semantic i nterpretation ♦ _ ' 

~ " ■ ~ 'c • • • . • -7" . • 

10< . fkct: . The meiribers of the Russian delegation are not 




dignatai-'ies. 



/•• 



fact: . The members, of the Russian delegation are ^ 

.visiting seve^^il dignitarie^- — ^ "' Z::^-'^-^ 
Q: Are the members of • the Russiaii delegation visiting Tx^..: 



A:" What do ypu mean by "visiting dignitari^c"?' 
^jormallv fi spfif^k <*r. u ses prcvioui f- i -nf-tJ i T ia L luii l u <U^AW hjEiiat«» 



question, and one approach^ would be,. to program our system^ attempt 
to do the same thing. It -mij^ht lobk^tiinough -its store of information . 

^on the members of th^^ussian delegation to See rtbw the>^are. 

/characterized* If the machine knows Ihat the Russians are dignitaries 



/%;ho are visiti(.ng, it will ansv;er 
R's aire ^isitiVig important- people, 



/es"; if It has the fact, that the 



' \ 1 - 

this tactic doe^sn't always work ^fo'r| people 

L ■ . t> 



■I. 



it will answer J^es" also*^ But 
, ^nd ift woh*t worTc-^for 



nc^' systenpfei|^ Suppose. th^ system knows the two facts stated in 10* 
Her^ the^syst em would have to discmbigu^te* The correct answer to - 
one interpretation of the questicl^i would be "Yes- they are visiting ' 
se^A^ral dignitaries" '-and *the answer to the other interpre'fatica * 
V70uld be ''No- - the-'^Russians are noi dignitaries." - — -r— : — 



/ 



ERIC 



Lexical'' agnbi^juxtv occurs when we^use. one ^word to refer to 
different objects or evcntls or relations in the wo rlds Most worrig ^ 
in the language are ambiguous in this'wav'; there are only a few, usually 
hignlv technical words \hat have 'one and only ohe meaning* Normally 
we can .eliminate all but\ one meaing of a word in a^ sente'nce by- 
r^terring to meanings of the other words^^lrPthe sentence and 
figui;jing out what the applf^opriate combinations are* But 



dccassionally vje have 'to ask what^'barticular wo^d means. 
^ ^ l^r;r~QT^ ^i crthe CRyntians^miss the Sxxrz Canal? l" 

A:^ I don*t:JaifiiL4^hat vipu mean by the, woi?d ••miss"" ^ ^ 
' * / . • ^ Do ydU jmean l'..,lpng for;/2. fail to find? 



^ 



Referential anibl3liity have proven to be far^'iaore difficult to; 



! 



i tie* 



^1 Ji^dJ^tJian the kin.ds vfe've talked^ about so farT—Yel^^it is-one' " 
/ that all' speakers of a' language can compriehendv anS one which I'm~- 



I 



very much afraid atfv goo^ ] q n*>«fhi'?nn ^ n r''?«>pi4^e-«f y fttftm will^ liflvw f n ~ 
C9pe wglth. I meat ione^be fore,, when talking about wbrds, that 

■they, are used to describe aj^d ^6 refer ^o, things orjevent^VetQ.^ ^ 

- '\ " 
Let|in;j^^et 

have sense 




a bit more cxp^icitvhere. yftiis^ds or phrases or sentences 

(or .descriptive/ conter^tTT Weirds, phrasWs^ sentences 

are usei- to refe4 to objects ^, events, -states of affairs « •tc.$'^ 
# l^et us say of a simple/ singular , noun or noun phrase that^its sehse' ^ 



is 4 a concept of an 'individuai ; and that it's referanf is in-indi^v-idvai^— 
Let'us say of a predicate'Jph^a^e , t hat - it s se nse is the pp epeyt-y 

4t 



, > whxch j.t expresses, and that it it uitd to refer to a clasff.of Individuals 

* • ■ ^ ■ . ' \ ■ , • ■ - ■ ^ ' ■ / . 

(eg. the predicate "is red" ref ef s to^ the class of tl)ings that /• 

V are red, and 'has as it's^\^ense the property of being* red.) •/ 



C Let US' say of a sent s^nce that its so pge is the prfposiftipn^e xpiieasfid 



\v that S and that 'its uscdXto reefer to a state of affaxx^s, or as r^f V 
some say t to a truth/ value. - j \\ 

36 far, I/ye 3aid that we" use words and se,ntences' to refer 

_^ ^ 1 : ~ ' » ~ f 

to Gtjects and^lasses of objects, and states of affairs. JJut what / 
is iisipprtant to be av;are of is tiic fact that we .dan also^ use them- to 



ERIC 



refer to their senses;, i.e. we use a or NP to refer not 'to an 
individual, but to the Individual concent.. We can use a Dredicafe'- 
to refer not to a class of^^^ob^ects , ^ but to a certain* property that' 

the class has^ and we can use\a^/^entence^^ npt td an actual 




/ 



state, af-faii's., but *;rather''''-eb'' thp 'proposition Expressed by the 



sentencej. ■ " • - ' • ■ 

.* . ^ -fijv ^ '<• . ' ' ■ ^ ^ ■ . ■' . -/ 

12 , eL% Th s Premier of Russia went to Egypt yesterday. ... 

• • ♦ ^ .'b)."' The- Premier of Russia must be" elected bv^the party.- 

■ i In- a;)-, I'm u|ing' the^.t^^ Premier <of Russia" t(* refer to ah 

1 U-lndiv-i^ual* /But in the most' obvioUs interpretation ~^^the_b)^^^ 

. - • sentence, I'm not using 'the te^m "the Premier of Russia" to refer, 

■ ' ^o^^tnTindividual at ail. I'm really saying that any Premi-er of. 

■' • ' ■ ' \ ' ' ' ^ 'fc* " ' ' ' ' • ' 

*, BAssia, whoever he isj must^be elected! by ."the party.. That i^, I.'m 

■ " ■ ■■• . ' ' \ ---,j-rL^' s-r 

using the term "the Premier . of Russia" .;to refer to. its sells e^-rj^.^ 

■■ .Of course,, in' the . other 'interpreation . of .b), I'm really relferring,-, 

* ' - ■ ■"- "•: . •' • ' ; ' • ' • \ K ' 

to'^an ihdiJ^idual; I might be. implying that tliat iiidiva/^ai is i^p 

different .'than anyone else. So i2b) is ambiguous ^ -in o'n^ 

. ..inLerprcLAtioii, the.les ^.^ke4y ^ o ^ e in th is Gase, I'm a <|t uall y : 

" refer^ring "to an' individual; in\ the other- interpretation, I'm^ot 

ref Wr^ing to^sitv indjviduiil at ill^.., l-2a)/,£%ndt^^ this 

...Vay. .The teito "Th€^P^^i(^'^pf^Mi^ 
iWoVan individual."'' 'use.' ■ -. '.t. "*' a- " "'. -V * • 



'--\ 



LVt- US ' look CatVl^b) next 



r 
J, 



\'13. a).' The Russian does rtpt have a hat. 



The Russ'ian^s hatfe lare' alvjays brown. 
13b) is aNsentence in which, in t^e mQs,t obvibus interpretation , 
' the predicate are° always brown, is. used to refer to its sense? 

. T^x— • - 

"C^ rather than t"p a p3^ss of- 



objects. In the other reading, the on^ 
to refer to a particular class pf|\ 



briwn hit-s, thfe inte;rpretatiorr>ou3^;^e. somet^^ like tfie Russian's 



• iiats are brown and lever ch^g^e^to any othei><c$lor they stay brpwn..^-W' 

"But notice that if the^ system had both_ a.) _and^ b)* stor^d-^^^ 
! \ " < '\ - \ • ^ ^ " 

.1 the only reading of b) would be the one in wh;^ch the terms 



•ERIC 



refej 



11 



13 



to their/ senses r not to objects in the world. Not let ua look 
at. a caSe^where a whole clause is ambiguous in this ^ay. \ 

, 1^. a) The Russians don't know the author of the UN; speech. 
* b'J^^^Jhe Russians believe that the author of. .the UN speech 

(' /' is a fool- ' . i . ^ 

In mb)>^he. clause following Relieve is; anibiguous' as ^o what* it 
ref^i^ to. . In one interpretation, it refers to a stafe of' affAii*s* 

ere is a author and he is a fool, and' the Russians believe xt.- 
But again, if we \have l^a) as a fact in the system, .the only possible 
--interprgtati^^ is:^e one in which the sentence following - 

" Relieve refers to\a^ prop.ositi^n. and hot to a state of ' affadrs . 
Ifftr) .^could be true feven if there ^ere no author and no UN speech. 
: \ Thi-s ambiguity ' in.^refe^^ is determined by the occurrence-- 
in .:thcse ' sentences ancl . others like;* them , of several verb , modal and / ^ 
adverb -classes:*, propositiortal attitude Vs like say , believe , thinjcjj j 
emotion verbs liKe^ v/ant jhope , would hate , ^adverbs like always , ^'j/. 
necessarily , possibly , modals like must , would ,. This, distinction 
is one that the ./philosophers have more to say about than„ linguists. ^ 
. Vntil recently, xi has beepi.ignored by linguists and you won't 

A^iTid much in linguistic literatupe on it. Life would be a lot > 

' \^ \ ' . ■ ' %' ^ ^ ^ ' ' ■ ' . :/ 

easier -If we coul/d ignore it,, but I don't think we can. We-'ve ' , 

seen how it might affect the* storage of fact s iti our system. Let'^ 

see how it mig;ht affect its question answering ability, 

'IS. fact: The Russians found a solution 

4e qV VJhat solution did the^ Russians find? 
A: I don't know/ the actual solution 



16.' fact: the. Russians sought a solution 
, . Q: what solution did the Russians seek 
, A: That's: a nonsensical question 
; " . • 12 14 ' ^ • 



^ ' Now. let us turn to relations betweegi sentences. If a^speak^i^ 
of Itdanguage knows the meaning- of a Sentence within that language, 
•he also knows that^tl^ere are certain relationships that hold between 

that /sentenbe and certain other sentences , and he knows what these ^ 

■/ ' " ''\[ ' ' / • * • \ ■ ' ! - ^ 

other sentence?, are. In order for a person toVJbe-able to answer 

questions about facts', he must understand/these relations between 

sentences-. Our. question answering system must do this also.* 

Probably the rao^t obvious y^lation between sentences, one that 

everyone would <^xpect me to mention, is sy^ionymy. So I'll m e n ^iqn-— 

if .-^ synonymy; But I. don't want to ^pend any time on it because 

7- it^s notoriously difficult to define, and I think ma^bauwe'-'^^a get 
away with not defining it d^^^ec^y:,^ 

^ ^^^ystem^,^_^d_Jor_d^ natural language* I think a^ 



lot of synonymy relations betwefen sentences can, be accounted for^^^n 
otherr.ways - for example, the rela-^ion between the sentences -"It 
Hook me a long time to write this p|iper" ant} "I took a long time 
^o write this paper" can accounted for in terms of their both 
having the same underlying structure. . The relation ,that^ I want to' ' 
focus on here is what I'm calling entailmeint-. In general, entail- 
ment is a relation between two sentences such that if one sentence 
is true,, then the other sentence has to be true also. Buit entailment 
takes several forms, and it is instructive to look at them in some^ y*, 

: detail . _ ' • yj' 

17. a) All of the digni-t^ries ar^ Russian 
4|) Some , of the dignitaries are Russian 
If we Icnow a) to be a fact, we' also know b) to be a fact because' 



.v;e-know the relationship between all a|d some . We've known about 
this Icind of entailment for a long time - anyone who's had a logic 
course will be aware of it. But we have been finding that this 



entailment relation holdvs between many more types of sentence 
-^nair9 than/had \been previously .noticed • 1 
r J 18* a) The Russians managed to warn the Egyptians-. 

b) The- Russians forgot to .x%rarn the Egyptians./ 
^o) T!)L\i' Russians expected to warn the Egyptians.,' 
"Tlf we knpw that a) is a fact, we also know -^hat the Russians .warned . 
the Egyptians. Another case of entailment. On t^je other hand,-^ 
.if v;.e knowTthat b) is a fact, v/e know that the Russ'ians didn't warn 
the-:Egvptiai>sr - a case' of negative? enta^ilment. But even if we. 
know^hat c)^^^ls :a ,f act, we do not ig|\9jy if the Russiax}& .did or did ' 
/not warn the Egyptians. . Verbs liKe manage ano^ forget are called 
\implicative verbs. , _ _ . 

. . There is a special kini of, entailment whiclxis son^etimes 



call e d the. "conve r se x ^ elatioii.'* — This is a relation of mutual 

2? ^ . . * 



.entailment ; i.e. , if A entails B', then B- entails 
19. fact: Russia sold' arms to Egypt. 
Q: Did Egyot buy arms from Russ 
. ' A: Yes 

We know that if Ru^^sia sold ^rms~ to Egypt, t/hen"^Egyift b<^^ 
arms f^om Russia. And . if Egypt bought arms/ from Russia, then 
• Russia sold anhs to Ep.ypt. It makes no di|ffirence swhich ife'^fts 

\' ■ ■ ' ' " ■-• ' X , 

^fact and which is the question. The answer/ is the; same. 




ERIC 



There are some interesting entailment relations that .show 
cl^early the interrelations between the v;,ards and the structural 
fok^ns with wliich thev' occur. Let us looi; at one involving verbs 
and tense forms: . ' . • / *, 

' — fctcf": — ThD-^PvUSslan; -began wai/king in "the park today. 

— Q: did -the Russian walk i^i the park todav? 



A*: yes 



21. fact: The Russian began walking to Washington today 
• . Q: did the Russian walk to Washington today? 
, " X A:;. I don't know , ^ , ' . ,>'. 

The. entailment relation between tjke- past ! progressive and simple, 
past ^olds in the walk case, but it does ;not hold for the walk to / \ 

cas^»^ . • . • 1 < ^ ' . • ^ ' " ' " ^ 
, > A sentence can entail many pther"^ sentences .\ But in the usual 
case what a sentence entails is not what the negation of that sentence , ^^/^j,^^ 



entails. The sentence "All of the dignitaries are RUfesian" .entail* 
the sentences "Some of the eigri^iaries are Russians" , But its 
.Afegatipn,^"Ail of the dignitaries are not RussiaA" does not, entail' 
"Some of the dignitaries are Russian." Bu.t for" certain sentence 
types, both the sentence and its negation entail the sanjie sentence 
Vlhen this occurs , we call the. relation one -of presupposition > In 
general^ their for a sentence A to presuppose a sentence B, then 
both A, and the negation df A must entail B. - * ^ 

.V 22. fact: The Russians (don't) realize that an insurgent - 
group is operating in Egypt r . ^ . -^d^ ^ 



^ Q: Is an insurgent group operating /in Egypt? 



A: yes • ' \ 

Notice, that the yes answer is correct for either fact; that :the 
Russians do realize that an insurgent group is operating in Egypt , ; 
and that the Russians don' t'lrealizc that an insurgent' group is operating 

.in; Egypt. This presupposition .relation occurs in this casii 
the sentence contains a fa^ive verb realize. . But it ais6 holds 
between sentences in which no f active verb appe^s^ , The sentence 
"It was Brutus who killed Caesar," presupposes the sentence "Someone 

^killed 6aesar. " 



ie because 



The presupposition relation has special significance for 

15 



. ' V''. 



question-^answering systems, because questipns carry presuppositions 
too. ^ In order to Rnow the correct answer to a question, ypu must 
know what its presuppositions are. ^Supposc^the system knows the 
fact in 23, but it doesn't know \any thing about when this occurred. 
-23. fact: |||*he 'Russians armed the Egyptians 

Q: When di<J the. Russians, arm the Egyptians? . ' > 
.^A: ' I dqn^Jtjkpow. ' • 

The question presuDDoses that the Russ\ans armed the Egyptians and , 
asks for additional information about that|Tact. Since the system 
doesn't have the additidnaX information, it correctly answers ^ 

"I don't know." ""'But suppose tl^at the machine had no information at all . 

t 

about the Russian's arming the Egyptians.' If voufask it the same 
^ uestidrT, %/hon did the Russians arm the Egyptian b ", the "I don't — 



know" answer would be misleading. . One approach /fp ban — 

*dling is by .having the system replv, "I can't explain a. ' . /' 

nonexistent fact. " , >This* looks like a neat solution* But the problem , 

/'*.•' . r ' .. .. • . 

is , even more* complicated than this. Suppose the presupposition of 

the question flatly contradicts a fact that. the system hfits stored, as in-^.^ 

.24. fact: the Russians* did not;arm the Egyptians ; \ 

0: vjhen did the Russians arm the Egyptians 

A: but ;the:Sr di'dn't 
In this case, .the "I don't kn6v;" answer would be inadefjuate ,^ and so 
would the "non-existent fact'' answerV The best answer would be. the 
one which contradicted the presupposition of the question, and* 
therefore made, the question irrelevant. . - : . 

- . One area that strikes me as being' an extremely difficiLlt_pne for 
designers of question-answering systems is the one involving, the 
pro,cess-of logical inference. As speakers of a. language, we can distinguisl 

: : : Z i-St . : 



between valid and invalid arguments expressed- in the language. 
Giyen two premises, we can tell whether the conclusion follows, 
One^ migLt argue that this is not really a problem of meaning, its ^ 
a problem of logic; But the decision as to whether a certain 
conclusion follows from a certain set of premises is dependent on 
the meanings of . those , sentences - thejn^anings of the words, and 
the si:ructures in which they occur. It would be desirable for 
our system- to be able to make inferences, li^ke the one , in 25. 



25. 



f ad t r The Rus s i anrr Tef t™when~ the'^^'^gyptians arrived . 
fact: Ihe Egyptians arrivejd at 2. : 



When did the Russians leaye? 
when, the Eg^rptians arrived 
„at' 2 ^ 




The first answer is certainly acceptable ^ .and , the system does not 
have jco make any inference in ,this case.f' The second answer is also ^ 
acceptable,, apd the system would have to make an inference. One 
could apgue^ that this ability t^ infer need not be programmed 
^ jLnto. the_sy^.tem because you could get both answer? anyway, by making 



it a two-step question. 

Q: When did. th^ Riis^ians leave? ' 
A: When the EgyptiWns arrived. 
, Q : ^ When did the Eg^iptians arrive : ^, 

' A:' _ at 2 \" . ' " ■ . I ■ ■ ■ 

•Sut this"! two-step question process will not always work. 

26. fact: 'All the -Egypti^s in Moscow are from' Cairo. 

fact: Mr?. Al ' Faiz is an .Egyptian in Moscow, 

■ ' ^^ ■ f • . - r ' ' 
■ Q: Is Mr. Al Faiz from Cairp?' . — • 



A: yes.- 



\ 



Given 'the facts of 26, the system that couldri^'t make inferences could 



^ only answer "I doh*t know^,"' This, it seems to m^, wouldrbe a waste. 
After all, the system has the information stored. What is^ lacking 
is a means to get at "that, information* ^ ' 

' This problem of "getting at", the inf ojrmation stored iii the. 
system is closely related to what some hayte called the. "Principle of 
Cooperation" between speakers, in an area|ihat's usually called 



..." ..." \ 

pragmatics, not semantics. Assuming two 
toward each other, they cooperate in sucl^^ 



4&l . ' ' \ 
speakers have good will 



way that even if the 
question askdd by speaker A cannot, be ..answered' precisely l^y speaker* - . 
B, .speaker B doesn^t ^give up'. He cooperates by giving what information 

\^ - - ^.-^ --ill ■ • . " ' : 

he' has.. Qlearly the most useful quest ioi) -answering system would 
coopepate /in the same way. _ ^'A'f 

' ■ ' 'Iv ... 

' . 27. fact: The Russians warned -^he, Egyptians four times in 
" . ■ ■ • . March, 1972. • !'••' 

Q: How many times did the /Russians warn the Egyptians 

. ' * ^ ' ' ' hi 

in 1972? 

A: I don't know. 



A: (at least) four time^/A ■ , . - 

fr' ^ ; ^' 

The question is not one for which tlie system is prepared. /But. an 

'/// ' \' 

"I don't know" answer would seem ijni'appropriate . Equally, . 

■ • : f'-!'' 

inappropriate is the answer"four times"-- it oyergeneralizes. In 



The -best' answer in this case is ,!/at least , four times'." 

^ ■ . y*^- 



both cases, the answer would "be ^iolating the principle of cooperation. 



\ . 

\ 



You may have noticed that/i/as.l have been talking about 
, ■' " '/-/ " ' " ' ' ' '". 

,presut>Dositxon and logical inf;^;rence and the principle of cooper^ion 

I hav6 been saying things lik# "the best answer" and"the most 

appropriate answer wou^d be "/If that., is, I have "been giving value 

■W ' " ' • ■ 

j\idgments. T^is is because #hen I think about these areas, I am ^ 



-less sure, and considerably more speculative, about how closely 



want our system to /inirror the abilities' of humans-. It may be the^t 
for many purposes y we could set our sights much lower, and not have. 



to concern ourselves with these^ areas at. all. But I think that 

we v;on^t know beforehand. V/e won*t know, one way or another, until 

v;e bui-ld-t4iese^-sys.tem3^^ - — and -that ^ s t he j ob I l Bav€~ti:?r~yt)in • ^ 

/ . Before /l finish, I would like to say something about what's 
going on in/linguistio£theor^t these days, with regard to^^the study 
of seman'tib structure of language. I^mentibned that one assumption , 
that most: of us make is that .the meaning of a sentence is composed of 



the meanings of its parts; that the notion of J^he- part/wfiole relation 

. ' V • 'V ' ' \ ' -^^r"^'" ' ' . 

is essentially a syntactic one. iMany tr&nSfDrmatir)nalists have taken 

-this^y>i:to--me.a^^-^ at a syntactic dcGcriDtio n is-^^ogAeal-ly p r ior to^ 

seir^antic description. In fact, in the early days of transformational 
tneory, the syntactic component of a description of a language was 
seen as** not only prior to but also independent of the semantic 
description of the lan^ ^e. But this assumption has not been held 
by everyone who is interested in language. Many philosophers, for 
example , have also been studying language^ , both natural and 
artificial. Many of these philosophers are logicians and logicians 
are free^ to construc^t* or^e^ whatever languages they want. ^ 

They are not limited as linguists are, to describe some pre-existing 

languages.. When they do construct languages, they construct 

_' _ __ y - /.^ — ^ - - 

them in such a way that they part/vjhple relation given by the syntax 

is exactly the ri/^ht part/whole relati^on needed for the semantics. 

Linguists in the^ast have tended to ignore the work done by < 

logicians for exactly tlils reason. They have argued that they are 

tied to the facts of natural language as. they exist , and not as 

they would like them to^be. V/hat the linguists f aile.?i.?^to see. 



^for a long time, is* that the semantic distinctions that 
logicians wanted 'to make in their artificial languages / 
were drawn fTom semantic distinctions that exist in natural 
language • When linguists began to take semantics / 



seriously, the part/whole problem reared its ugly Head again* The 



gai] 



argument raging among transformational linguists nowaday^s Is 
.essentially whether the correct part/whole distinctions nieeded 
^fo3?— syrrtaJr^ the correct part/whole distinctions^ neied(ia\for* " 
semantics. Another way of putting this'-'tproblem i^'tc^-apc the 
question "Is the^^nderlyin^, syntactic structure of a language 
semantically transparent?^'/ ^ One, camp, the generative semanticists 
argue that it is, and t^e other camp, the interpretiv^sts argue 
that it isn't* A number of linguists have been turning to the 
logicians to see what use they can make of their, recjent work in 
answering the questions that have been raised* , And// there are now 
a. number of linguists and logicians who are p,ur suing, the notion^, ^ 
of a logic for natural language, "natural, logic," yone that combines 

' ' ^ ■ • . ' - " // ^ . \ ^ 

the syntactic insights of the linguists and| t\ie |emant^ic insightsX 
of the logicians* Anyway, the controversy rage^y, and it is often,/^* 
distressing to those of us in the middle, although it is probably 
product i|^e-v, for the field as a whole But I think that* in the end. 



the theoreticians will not be able to satisfactorily answer these. 
questions unless they get fee'dback from the ^'eople who try to put 
these theories, to use. A linguistic, theory /will be considered 
good only insofar as it can 'explain part of. what we do during the 
process of communication • The attempt to ^simulate this process • 
using .the various theories can give valuable aid in helping to 
decide which theories are better, and.fo^ what purposes,. 



